Video Summarization by Curve Simpli cationDaniel

A video sequence can be represented as a trajectory curve in a high dimensional feature space. This video curve can be analyzed by tools similar to those developed for planar curves. In particular, the classic binary curve splitting algorithm has been found to be a useful tool for video analysis. With a splitting condition that checks the dimensionality of the curve segment being split, the video curve can be recursively simpliied and represented as a tree structure, and the frames that are found to be junctions between curve segments at diierent levels of the tree can be used as keyframes to summarize the video sequences at diierent levels of detail. These keyframes can be combined in various spatial and temporal conngurations for browsing purposes. We describe a simple video player that displays the keyframes sequentially and lets the user change the summarization level on the y with a slider. We also describe an approach to automatically selecting a summarization level that provides a concise and representative set of keyframes.